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ABSTRACT 



A hand-scoring system for a three-level 
conf idence- nar king scheme for short answer and gnu It iple-choice tests 
is described. The scoring system is for a test where the student is 
asked to indicate for each answer whether the probability of his 
being correct is more than 1/2 (sure), 1/2 (neutral), or less than 
1/2 (guess) . The effect of the system is to add i/3 of a point for 
each response if the student is correct and sure, or wrong and 
guessed; to subtract 1/3 point if the student is correct and guessed, 
or wrong and sure; and not to alter the score for neutral responses. 
Although the system will probably double the time required for 
scoring, it is simple and mechanical. A sample answer sheet and 
student instruction form are included. (DG) 



A HAND-SCORING SYSTEM FOR CONFIDENCE-WEIGHTED SCORES 



fM 

CO 

- 4 - 

O 



UJ 



Andrew A’r Icren 
Harvard University 



EOI'CATION 

t « 1 1 c & mcE0F EOUCJ riON 

THIS DOCUMENT HA « BEE, I REPRn^.rtr, 
« ?(0N 2?" *« « «VS A°l 

CAHON POSITION OR POUCV D 



The system described here is based on a three- 
level ccnf idence-raarking scheme. Scoring will probably 
take about twice as long as usual. The scoring steps 
are simple enough for students to do themselves, at 
least at the high school level, 

Ira student feels that the chances are better than 
50:50 that his answer is correct, he should mark X in 
the "sure" box next to r^s answer. If he feels the chances 
are less than 50:50, he should mark X in the "guess" box. 
Not marking either box indicares chances of about 50:50 
»' "uncertain" ) or "I don't wane to play the game." 

The answer key is placed against the answer column 
as usual. But instead of narking only the correct answers, 
b<. th correct and incorrect answers are marked: when an 

answer is correct, the instructor circles one "sure" box; 
when the answer is incorr.ct, the "guess" box is circled. 
The \/eightcd score is then derived from three counts: 
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STUDENT INSTRUCTIONS 



On this test we would like to find out, besides how 
many right answers you know, if you can tell when you know 
the right answer and when you don't. For each question you 
can mark one of three levels of confidence in your answer; 

mark the "sure" box if you think that your 

chances of being right are 
better than 50:50 

don't mark either box if you think that your 

chances of being right 
are Just about 50:50 
(for example, if you can’t 
decide between two answers) 

mark the "guess" box if you think that your chances 

of being right arc less than 

50:50 

Your test score will be adjusted for how appropriately 
you mark your confidence. The aliustment does not depend 
directly on how high your confidence is, but on how often you 
mark right answers "jure" and mark wrong answers "guess". 

The scoring system has been designed so that you can expect 
to get your highest score by honesrly marking the confidence 
you feel. 

If you don't mark either box, you will get the usual 
score: 1 point for a correct answer, 0 for a wrong answer. 

If you mark "sure" or "guess", you will gain or lose 1/3 
point, depending on whether your answer is correct or not: 
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